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CN , Abstract 

This paper studies the tradeoff between channel coding and ARQ (automatic repeat request) in 
Rayleigh block-fading channels. A heavily coded system corresponds to a low transmission rate with 
CO I few ARQ re-transmissions, whereas lighter coding corresponds to a higher transmitted rate but more re- 

transmissions. The optimum error probability, where optimum refers to the maximization of the average 
successful throughput, is derived and is shown to be a decreasing function of the average signal-to-noise 
Q ' ratio and of the channel diversity order A general conclusion of the work is that the optimum error 

probability is quite large (e.g., 10% or larger) for reasonable channel parameters, and that operating 
. at a very small error probability can lead to a significantly reduced throughput. This conclusion holds 

(N 

feedback errors, are taken into account. 

O 
^' 

Q>^ [ I. Introduction 



O 



even when a number of practical ARQ considerations, such as delay constraints and acknowledgement 



In contemporary wireless communication systems, ARQ (automatic repeat request) is generally used 



^ . above the physical layer (PHY) to compensate for packet errors: incorrectly decoded packets are de- 

' tected by the receiver, and a negative acknowledgement is sent back to the transmitter to request a 

re-transmission. In such an architecture there is a natural tradeoff between the transmitted rate and ARQ 
re-transmissions. A high transmitted rate corresponds to many packet errors and thus many ARQ re- 
transmissions, but each successfully received packet contains many information bits. On the other hand, 
a low transmitted rate corresponds to few ARQ re-transmissions, but few information bits are contained 
per packet. Thus, a fundamental design challenge is determining the transmitted rate that maximizes the 
rate at which bits are successfully delivered. Since the packet error probability is an increasing function 
of the transmitted rate, this is equivalent to determining the optimal packet error probability, i.e., the 
optimal PHY reliability level. 
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We consider a wireless channel where the transmitter chooses the rate based only on the fading statistics 
because knowledge of the instantaneous channel conditions is not available (e.g., high velocity mobiles 
in cellular systems). The transmitted rate-ARQ tradeoff is interesting in this setting because the packet 
error probability depends on the transmitted rate in a non-trivial fashion; on the other hand, this tradeoff 
is somewhat trivial when instantaneous channel state information at the transmitter (CSIT) is available 
(see Remark [Hi. 

We begin by analyzing an idealized system, for which we find that making the PHY too reliable can lead 
to a significant penalty in terms of the achieved goodput (long-term average successful throughput), and 
that the optimal packet error probability is decreasing in the average SNR and in the fading selectivity 
experienced by each transmitted codeword. We also see that for a large level of system parameters, 
choosing an error probability of 10% leads to near-optimal performance. We then consider a number of 
important practical considerations, such as a limit on the number of ARQ re-transmissions and unreliable 
acknowledgement feedback. Even after taking these issues into account, we find that a relatively unreliable 
PHY is still preferred. Because of fading, the PHY can be made reliable only if the transmitted rate is 
significantly reduced. However, this reduction in rate is not made up for by the corresponding reduction 
in ARQ re-transmissions. 

A. Prior Work 

There has been some recent work on the joint optimization of packet-level erasure-correction codes 
(e.g., fountain codes) and PHY-layer error correction Hl-Bl- The fundamental metric with erasure codes 
is the product of the transmitted rate and the packet success probability, which is the same as in the 
idealized ARQ setting studied in Section JII] Even in that idealized setting, our work differs in a number 
of ways. References |[T1, Q, ||4l study multicast (i.e., multiple receivers) while [2] considers unicast 
assuming no diversity per transmission, whereas our focus is on the unicast setting with diversity per 
transmission. Furthermore, our analysis provides a general explanation of how the PHY reliability should 
depend on both the diversity and the average SNR. In addition, we consider a number of practical issues 
specific to ARQ, such as acknowledgement errors (Section HVl ). as well as hybrid-ARQ (Section |V]|. 

n. System Model 

We consider a Rayleigh block-fading channel where the channel remains constant within each block 
but changes independently from one block to another. The t-th {t = 1, 2, • • • ) received channel symbol 
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in the i-th (i = 1, 2, • • • 



) fading block yt^t is given by 



yt^i = VSNR hiXt^i + zt^i 



(1) 



where hi ~ CAA(0, 1) represents the channel gain and is i.i.d. across fading blocks, xt^i ~ CM{0, 1) 
denotes the Gaussian input symbol constrained to have unit average power, and zt^i ~ CJ\f{0, 1) models 
the additive Gaussian noise assumed to be i.i.d. across channel uses and fading blocks. Although we 
focus on single antenna systems and Rayleigh fading channel, our model can be easily extended to 
multiple-input and multiple-output (MIMO) systems and other fading distributions as commented upon 
in Remark [21 

Each transmission (i.e., codeword) is assumed to span L fading blocks, and thus L represents the 
time/frequency selectivity experienced by each codeword. In analyzing ARQ systems, the packet error 
probability is the key quantity. If a strong channel code (with suitably long blocklength) is used, it 
is well known that the packet error probability is accurately approximated by the mutual information 
outage probability Q-lUl. Under this assumption (which is examined in Section HV-AI) . the packet error 
probability for transmission at rate R bits/symbol is given by \9. eq (5.83)]: 



Here we explicitly denote the dependence of the error probability on the average signal-to-noise ratio 
SNR, the selectivity order L, and the transmitted rate R. We are generally interested in the relationship 
between R and e for particular (fixed) values of SNR and L. When SNR and L are constant, R can 
be inversely computed given some e; thus, throughout the paper we replace R with i?^ wherever the 
relationship between R and e needs to be explicitly pointed out. 

The focus of the paper is on simple ARQ, in which packets received in error are re-transmitted and 
decoding is performed only on the basis of the most recent transmission!^ More specifically, whenever the 
receiver detects that a codeword has been decoded incorrectly, a NACK is fed back to the transmitter. On 
the other hand, if the receiver detects correct decoding an ACK is fed back. Upon reception of an ACK, 
the transmitter moves on to the next packet, whereas reception of a NACK triggers re-transmission of the 
previous packet. ARQ transforms the system into a variable -rate scheme, and the relevant performance 
metric is the rate at which packets are successfully received. This quantity is generally referred to as the 
long-term average goodput, and is clearly defined in each of the relevant sections. And consistent with 
the assumption of no CSIT (and fast fading), we assume fading is independent across re-transmissions. 

' Hybrid-ARQ, which is a more sophisticated and powerful form of ARQ, is considered in Section [Vl 




(2) 
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III. OPTIMAL PHY Reliability in the Ideal Setting 

In this section we investigate the optimal PHY reUabiUty level under a number of idealized assumptions. 
Although not entirely realistic, this idealized model yields important design insights. In particular, we 
make the following key assumptions: 

• Channel codes that operate at the mutual information limit (i.e., packet error probability is equal to 
the mutual information outage probability). 

• Perfect error detection at the receiver. 

• Unlimited number of ARQ re-transmissions. 
. Perfect ACK/NACK feedback. 

In Section |IV] we relax these assumptions, and find that the insights from this idealized setting generally 
also apply to real systems. 

In order to characterize the long-term goodput in this idealized setting. In order to do so, we must 
quantify the number of transmission attempts/ ARQ rounds needed for successful transmission of each 
packet. If we use Xi to denote the number of ARQ rounds for the /-th packet, then a total of X]/=i ^« 
ARQ rounds are used for transmitting J packets; note that the Xj's are i.i.d. due to the independence 
of fading and noise across ARQ rounds. Each codeword is assumed to span n channel symbols and to 
contain h information bits, corresponding to a transmitted rate of R = b/n bits/symbols. The average rate 
at which bits are successfully delivered is the ratio of the bits delivered to the total number of channel 
symbols required. The goodput t] is the long-term average at which bits are successfully delivered, and 
by taking J — )• oo we get 1,101 : 

where X is the random variable describing the ARQ rounds required for successful delivery of a packet. 

Because each ARQ round is successful with probability 1 — e, with s defined in (O, and rounds are 
independent, X is geometric with parameter 1 — e and thus K[X] = 1/(1 — e). Based upon we have 

r? ^ Re{l - e), (4) 

where the transmitted rate is denoted as i?^ to emphasize its dependence on e. 

Based on this expression, we can immediately see the tradeoff between the transmitted rate, i.e. the 
number of bits per packet, and the number of ARQ re-transmissions per packet: a large i?^ means 
many bits are contained in each packet but that many re-transmissions are required, whereas a small i?e 
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corresponds to fewer bits per packet and fewer re-transmissions. Our objective is to find the optimal (i.e., 
goodput maximizing) operating point on this tradeoff curve for any given parameters SNR and L. 

Because is a function of e (for SNR and L fixed), this one-dimensional optimization can be phrased 
in terms of i?^ or e. We find it most insightful to consider e, which leads to the following definition: 

Definition 1: The optimal packet error probability, where optimal refers to goodput maximization with 
goodput defined in for average signal-to-noise ratio SNR and per-codeword selectivity order L is: 

e''(SNR,L) = argmax Re{l - e). (5) 

£ 

By finding e*(SNR,L), we thus determine the optimal PHY reliabihty level and how this optimum 
depends on channel parameters SNR and L, which are generally static over the timescale of interest^ 
For L = 1, a simple calculation shows 

e'^(SNR, 1) = 1 - e(l-SNR)/(SNR.H/(SNR))^ 

where W{-) is the Lambert W function lITll . Unfortunately, for L > 1 it does not seem feasible to find 
an exact analytical solution because a closed-form expression for the outage probability exists only for 
L = 1. However, the optimization in ^ can be easily solved numerically (for arbitrary L). In addition, 
an accurate approximation to e*(SNR, L) can be solved analytically, as we detail in the next subsection. 

In order to provide a general understanding of e*, Fig. \T\ contains a plot of goodput r] (numerically 
computed) versus outage probability e for L = 2 and L = 5 at SNR = and 10 dB. For each curve, the 
goodput-maximizing value of e is circled. From this figure, we make the following observations: 

• Making the physical layer too reliable or too unreliable yields poor goodput. 

• The optimal outage probability decreases with SNR and L. 

These turn out to be the key behaviors of the coding-ARQ tradeoff, and the remainder of this section is 
devoted to analytically explain these behaviors through a Gaussian approximation. 

Remark 1: Throughput the paper we consider the setting without channel state information at the 
transmitter (CSIT). If there is CSIT, which generally is the case when the fading is slow relative to 
the delay in the channel feedback loop, the optimization problem in Definition [7] turns out to be trivial. 
When CSIT is available, the channel is essentially AWGN with an instantaneous SNR that is determined 

^Note that in this definition we assume all possible code rates are possible; nonetheless, this formulation provides valuable 
insight for systems in which the transmitter must choose from a finite set of code rates. 

^The expression for L = 1 is also derived in |2|. However, authors in [2| only consider L — 1 case rather than L > 1 
scenarios, which are further investigated in our work. 
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by the fading realization but is known to the TX. If a capacity-achieving code with infinite codeword 
block-length is used in the AWGN channel, the relationship between error and rate is a step-function: 

0, if i?<log2(l + SNR|/i|2) (7a) 

1, if > log2 (l + SNR|/i|2). (7b) 
Thus, it is optimal to choose a rate very slightly below the instantaneous capacity log2 (l + SNR|/ip). 
For realistic codes with finite blocklength, the e-R curve is not a step function but nonetheless is very 
steep. For example, for turbo codes the waterfall characteristic of error vs. SNR curves (for fixed rate) 
translates to a step-function-like error vs. rate curve for fixed SNR. Therefore, the transmitted rate should 
be chosen close to the bottom of the step function. 

A. Gaussian Approximation 

The primary difficulty in finding e*(SNR, L) stems from the fact that the outage probability in Q can 
only be expressed as an L-dimensional integral, except for the special case L = 1. To circumvent this 
problem, we utilize a Gaussian approximation to the outage probability used in prior work |[T2l - lfT4l . 
The random variable log2 (l + SNR|/ijp) is approximated by a 7\A (/^(snr), (j^(snr)/L) random 

variable, where //(snr) and (T^(snr) are the mean and the variance of log2 (l + SNR|/ip), respectively: 

Ai(SNR) = E|;,| [log2(l+SNR|/l|2)] , (8) 

a2(SNR) = E|^| [log2(l+SNR|/l|2)]'-;u2(SNR). (9) 

Closed forms for these quantities can be found in |[T5l . |[T6l . Based on this approximation we have 

where Q{-) is the tail probability of a standard normal. Solving this equation for and plugging into 
dl]) yields the following approximation for the goodput, which we denote as rjg-. 

r?, = (^^(SNR) - (1 - e), (11) 

where Q~^{e) is the inverse of the Q function. 

B. Optimization of Goodput Approximation 

The optimization of rjg turns out to be more tractable. We first rewrite rjg as 

7?3 = /i(SNR)(l-K-Q-i(e))(l-e), (12) 
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where the constant k G (0, 1) is the /u-normaUzed standard deviation of the received mutual information: 

(13) 

;u(snr)vL 

We can observe that n decreases in SNR and L. We now define e* as the r/^ -maximizing outage probability: 

e*(SNR,L) = argmax [l - k ■ Q-^{e)) {I - e), (14) 

where we have pulled out the constant //(snr) from (fTl)) because it does not affect the maximization. 

Proposition 1: The PHY reliabiUty level that maximizes the Gaussian approximated goodput is the 
unique solution to the following fixed point equation: 

(Q-\el) - (1 - £p • {Q-\e))' \e=e*)~' = K. (15) 

Furthermore, e* is increasing in k. 

Proof: See Appendix lAl ■ 
We immediately see that e* depends on the channel parameters only through k. Furthermore, because 
K is decreasing in SNR and L, we see that decreases in L (i.e., the channel selectivity) and SNR. 
Straightforward analysis shows that e* tends to zero as L increases approximately as 1/ ^J L\ogL, while 
e* tends to zero with SNR approximately as 1 / Vlog SNR. 

In Fig. m the exact optimal e* and the approximate-optimal e* are plotted vs. SNR (dB) for L = 2, 5, 
and 10. The Gaussian approximation is seen to be reasonably accurate, and most importantly, correctly 
captures behavior with respect to L and SNR. 

In order to gain an intuitive understanding of the optimization, in Fig. |3] the success probability 1 — e 
(left) and the goodput r/ = — e) (right) are plotted versus the transmitted rate R for SNR = 10 
dB. For each L the goodput-maximizing operating point is circled. First consider the curves for L = 5. 
For R up to approximately 1.5 bits/symbol the success probability is nearly one, i.e., e « 0. As a 
result, the goodput rj is approximately equal to R for R up to 1.5. When R is increased beyond 1.5 
the success probability begins to decrease non-negligibly but the goodput nonetheless increases with R 
because the increased transmission rate makes up for the loss in success probability (i.e., for the ARQ 
re-transmissions). However, the goodput peaks at i? = 2.3 because beyond this point the increase in 
transmission rate no longer makes up for the increased re-transmissions; visually, the optimum rate (for 
each value of L) corresponds to a point beyond which the success probability begins to drop off sharply 
with the transmitted rate. 

To understand the effect of the selectivity order L, notice that increasing L leads to a steepening 
of the success probability-rate curve. This has the effect of moving the goodput curve closer to the 
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transmitted rate, which leads to a larger optimum rate and a larger optimum success probability (1 — e*). 
To understand why e* decreases with SNR, based upon the rewritten version of r]g in (fT2l) we see that the 
governing relationship is between the success probability 1 — e and the normalized, rather than absolute, 
transmission rate R/fi{Sh\R). Therefore, increasing SNR steepens the success probability-normalized rate 
curve (similar to the effect of increasing L) and thus leads to a smaller value of e*. 

Is is important to notice that the optimum error probabilities in Fig. |2] are quite large, even for large 
selectivity and at high SNR levels. This follows from the earlier explanation that decreasing the error 
probability (and thus the rate) beyond a certain point is inefficient because the decrease in ARQ re- 
transmissions does not make up for the loss in transmission rate. 

To underscore the importance of not operating the PHY too reliably, in Fig. |4]goodput is plotted versus 
SNR (dB) for L = 2 and 10 for the optimum error probability ?7(e*) as well as for e = 0.1, 0.01, and 
0.001. Choosing e = 0.1 leads to near-optimal performance for both selectivity values. On the other 
hand, there is a significant penalty if e = 0.01 or 0.001 when L = 2; this penalty is reduced in the 
highly selective channel (L = 10) but is still non-negligible. Indeed, the most important insight from this 
analysis is that making the PHY too reliable can lead to a significant performance penalty; for example, 
choosing e = 0.001 leads to a power penalty of approximately 10 dB for L = 2 and 2 dB for L = 10. 

Remark 2: Proposition\l\shov/s e* is only determined by k, which is completely determined by the 
statistics of the received mutual information per packet. This implies our results can be easily extended 
to different fading distributions and to MIMO by appropriately modifying /x(snr) and cr(SNR). 

IV. OPTIMAL PHY Reliability in the Non-ideal Setting 

While the previous section illustrated the need to operate the PHY at a relatively unreliable level under 
a number of idealized assumptions, a legitimate question is whether that conclusion still holds when the 
idealizations of Section |lll] are removed. Thereby motivated, in this section we begin to carefully study 
the following scenarios one by one: 

• Finite codeword block-length. 

• Imperfect error detection. 

• Limited number of ARQ rounds per packet. 
. Imperfect ACK/NACK feedback. 

As we shall see, our basic conclusion is upheld even under more realistic assumptions. 
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e(n,SNR,L,i?) 



A. Finite Codeword Block-length 

Although in the previous section we assumed operation at the mutual information of infinite blocklength 
codes, real systems must use finite blocklength codes. In order to determine the effect of finite blocklength 
upon the optimal PHY reliability, we study the mutual information outage probability in terms of the 
information spectrum, which captures the block error probability for finite blocklength codes. In IfTTl . it 
was shown that actual codes perform quite close to the information spectrum-based outage probability. 

By extending the results of fTTl . |[T8l . the outage probability with blocklength n (symbols) is 

iE'odi+N^sN„)+ij:UJ|i|^.i:.j<ii , (16, 

1=1 1=1 \y j=i I 

where R is the transmitted rate in nats/symbol, and Wjj's are i.i.d. Laplace random variables lITSl . each 
with zero mean and variance two. The first term in the sum is the standard infinite blocklength mutual 
information expression, whereas the second term is due to the finite blocklength, and in particular captures 
the effect of atypical noise realizations. This second term goes to zero as n — )• oo (i.e., atypical noise 
does not occur in the infinite blocklength Umit), but cannot be ignored for finite n. 

The sum of i.i.d. Laplace random variables has a Bessel-K distribution, which is difficult to compute 
for large n but can be very accurately approximated by a Gaussian as verified in [17|. Thus, the mutual 
information conditioned on the L channel reaUzations is approximated by a Gaussian random variable: 



-> log (1 + /liPsNR) , - > , ' V, ,^ -\ (17) 

\ i=l i=l / 

(This is different from Section IIII-AI where the Gaussian approximation is made with respect to the 
fading realizations). Therefore, we can approximate the outage probability with finite block-length n by 
averaging the cumulative distribution function (CDF) of dTTl ) over different channel realizations: 

■ T E,-l log (1 + |/iiPSNR) - i?\ 

L l^i=l n(H 



i(l+|/i,pSNR) 

In Fig. |5j we compare finite and infinite blocklength codes by plotting success probability 1 — e vs. 
(bits/symbol) for L = 10 at SNR = and 10 dB. It is clearly seen that the steepness of the success-rate 
curve is reduced by the finite blocklength; this is a consequence of atypical noise realizations. 

We can now consider goodput maximization for a given blocklength n: 

e*(SNR,L,n)= argmaxi?£(l - e), (19) 

e 

where both R^ and e are computed (numerically) in the finite codeword block-length regime. 
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In Fig. [6l the optimal e vs. SNR (dB) is plotted for both finite block-length coding and infinite block- 
length coding. We see that the optimal error probability becomes larger, as expected by success-rate curves 
with reduced steepness in Fig. |5] At high SNR, the finite block-length coding curve almost overlaps the 
infinite block-length coding curve because the unusual noise term in the mutual information expression 
is negligible for large values of SNR. As expected, the optimal reliability level with finite blocklength 
codes does not differ significantly from the idealized case. 

B. Non-ideal Error Detection 

A critical component of ARQ is error detection, which is generally performed using a cyclic redundancy 
check (CRC). The standard usage of CRC corresponds to appending k parity check bits to h—k information 
bits, yielding a total of h bits that are then encoded (by the channel encoder) into n channel symbols. 
At the receiver, the channel decoder (which is generally agnostic to CRC) takes the n channel symbols 
as inputs and produces an estimate of the h bits, which are in turn passed to the CRC decoder for error 
detection. A basic analysis in 1191 shows that if the channel decoder is in error (i.e., the b bits input to 
the channel encoder do not match the h decoded bits), the probability of an undetected error (i.e., the 
CRC decoder signals correct even though an error has occurred) is roughly 2~^. Therefore, the overall 
probability of an undetected error is well approximated by e • 2~^. 

Undetected errors can lead to significant problems, whose severity depends upon higher network layers 
(e.g., whether or not an additional layer of error detection is performed at a higher layer) and the 
application. However, a general perspective is provided by imposing a constraint p on the undetected 
error probability, i.e., e • 2^^ < p. Based on this constraint, we see that the constraint can be met by 
increasing k, which comes at the cost of overhead, or by reducing the packet error probability e, which 
can significantly reduce goodput (Section Hill) . The question most relevant to this paper is the following: 
does the presence of a stringent constraint on undetected error probability motivate reducing the PHY 
packet error probability e? 

The relevant quantity, along with the undetected error probability, is the rate at which information bits 
are correctly delivered, which is: 



where i?e — ^ is the effective transmitted rate after accounting for the parity check overhead. It is then 




(20) 
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relevant to maximize this rate subject to the constraint on undetected errorQ: 

(e\k*)= argmax ( - -] ■ (I - e) (21) 

e,k \ n J 

subject to e • 2"'^ < p 

Although this optimization problem (nor the version based on the Gaussian approximation) is not 
analytically tractable, it is easy to see that the solution corresponds to k* = [— log2(p/e*)] , where e* 
is roughly the optimum packet eiTor probability assuming perfect error detection (i.e. the solution from 
Section HID ). In other words, the undetected error probability constraint should be satisfied by choosing 
k sufficiently large while leaving the PHY transmitted rate nearly untouched. To better understand this, 
note that reducing A: by a bit requires reducing e by a factor of two. The corresponding reduction in CRC 
overhead is very small (roughly 1/n), while the reduction in the transmitted rate is much larger. Thus, if 
we consider the choices of e and k that achieve the constraint with equality, i.e., k = — log2(p/e), goodput 
decreases as e is decreased below the packet error probability which is optimal under the assumption of 
perfect error detection. In other words, operating the PHY at a more reliable point is not worth the small 
reduction in CRC overhead. 

C. End-to-End Delay Constraint 

In certain applications such as Voice-over-IP (VoIP), there is a limit on the number of re-transmissions 
per packet as well as a constraint on the fraction of packets that are not successfully delivered within 
this limit. If such constraints are imposed, it may not be clear how aggressively ARQ should be utiUzed. 

Consider a system where any packet that fails on its d-th attempt is discarded (i.e., at most d — 1 
re-transmissions are allowed), but at most a fraction q of packets can be discarded, where (7 > is a 
reliability constraint. Under these conditions, the probability a packet is discarded is e'^, i.e., the probabiUty 
of d consecutive decoding failures, while the long-term average rate at which packets are successfully 
delivered still is -Re(l — e). To understand why the goodput expression is unaffected by the delay limit, 
note that the number of successfully delivered packets is equal to the number of transmissions in which 
decoding is successful, regardless of which packets are transmitted in each slot. The delay constraint 
only affects which packets are deUvered in different slots, and thus does not affect the goodputjfl 

''For the sake of compactness, the dependence of e* and k* upon SNR, L and n is suppressed henceforth, except where 
explicit notation is required. 

^The goodput expression can alternatively be derived by computing the average number of ARQ rounds per packet (accounting 
for the limit d), and then applying the renewal-reward theorem 1201 . 
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Since the discarded packet probability is e'^, the reUabiUty constraint requires e < q^^^. We can thus 
consider maximization of goodput Re{l — e) subject to the constraint e < q^^'^. Because the goodput 
is observed to be concave in e, only two possibilities exist. If qd is larger than the optimal value of e 
for the unconstrained problem, then the optimal value of e is unaffected by q. In the more interesting 
and relevant case where qd is smaller than the optimal unconstrained e, then goodput is maximized by 
choosing e equal to the upper bound q d . 

Thus, a strict delay and reliability constraint forces the PHY to be more reliable than in the uncon- 
strained case. However, amongst all allowed packet error probabilities, goodput is maximized by choosing 
the largest. Thus, although strict constraints do not allow for very aggressive use of ARQ, nonetheless 
ARQ should be utilized to the maximum extent possible. 

D. Noisy ACK/NACK Feedback 

We finally remove the assumption of perfect acknowledgements, and consider the realistic scenario 
where ACK/NACK feedback is not perfect and where the acknowledgement overhead is factored in. 
The main issue confronted here is the joint optimization of the reliability level of the forward data 
channel and of the reverse acknowledgement (feedback/control) channel. As intuition suggests, reliable 
communication is possible only if some combination of the forward and reverse reliability levels is 
sufficiently large; thus, it is not clear if operating the PHY at a relatively unreliable level as suggested in 
earlier sections is appropriate. The effects of acknowledgement errors can sometimes be reduced through 
higher-layer mechanisms (e.g., sequence number check), but in order to shed the most light on the issue of 
forward/reverse reliability, we focus on an extreme case where acknowledgement errors are most harmful. 
In particular, we consider a setting with delay and reliability constraints as in Section IIV-CI and where 
any NACK to ACK eiTor leads to a packet missing the delay deadline. We first describe the feedback 
channel model, and then analyze performance. 

1 ) Feedback Channel Model: We assume ACK/NACK feedback is performed over a Rayleigh fading 
channel using a total of / symbols which are distributed on independently faded subchannels; here 
Lfb is the diversity order of the feedback channel, which need not be equal to L, the forward channel 
diversity order. Since the feedback is binary, BPSK is used with the symbol repeated on each sub-channel 
//Lfb times. For the sake of simplicity, we assume that the feedback channel has the same average SNR 
as the forward channel, and that the fading on the feedback channel is independent of the fading on the 
forward channel. 

After maximum ratio combining at the receiver, the effective SNR is (//La) • SNR • Ylf=i M'^, where 
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hi, - ■ ■ 1 ^L,b are the feedback channel fading coefficients. The resulting probability of error (denoted by 
efb), averaged over the fading reaUzations, is EH: 



1 \ Lfb ilb— 1 /T 1 I -X / 1 I \ j 



where ly = a/yS^^^1§^- Clearly, Sfb is decreasing in / and SNr]^ 



-(//iib)-: 

2j Performance Analysis: In order to analyze performance with non-ideal feedback, we must first 
specify the rules by which the transmitter and receiver operate. The transmitter takes precisely the same 
actions as in Section IIV-CI the transmitter immediately moves on to the next packet whenever an ACK 
is received, and after receiving d — 1 consecutive NACK's (for a single packet) it attempts that packet 
one last time but then moves on to the next packet regardless of the acknowledgement received for the 
last attempt. Of course, the presence of feedback errors means that the received acknowledgement does 
not always match the transmitted acknowledgement. The receiver also operates in the standard manner, 
but we do assume that the receiver can always determine whether or not the packet being received is the 
same as the packet received in the previous slot, as can be accomplished by a simple correlation; this 
reasonable assumption is equivalent to the receiver having knowledge of acknowledgement errors. 

In this setup an ACK— >NACK error causes the transmitter to re-transmit the previous packet, instead 
of moving on to the next packet. The receiver is able to recognize that an acknowledgement error has 
occurred (through correlation of the current and previous received packets), and because it already decoded 
the packet correctly it does not attempt to decode again. Instead, it simply transmits an ACK once again. 
Thus, each ACK— s-NACK error has the relatively benign effect of wasting one ARQ round. 

On the other hand, NACK— s-ACK errors have a considerably more deleterious effect because upon 
reception of an ACK, the transmitter automatically moves on to the next packet. Because we are 
considering a stringent delay constraint, we assume that such a NACK— )>ACK error cannot be recovered 
from and thus we consider it as a lost packet that is counted towards the reliability constraint. This is, in 
some sense, a worst-case assumption that accentuates the effect of NACK— )>ACK errors; some comments 
related to this point are put forth at the end of this section. 

To more clearly illustrate the model, the complete ARQ process is shown in Fig. |7] for d = 3. Each 
branch is labeled with the success/failure of the transmission as well as the acknowledgement (including 
errors). Circle nodes refer to states in which the receiver has yet to successfully decode the packet, whereas 

^Asymmetric decision regions can be used, in whicii case 0^-1 and 1 ^> errors have unequal probabilities. However, this 
does not significantly affect performance and thus is not considered. 
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triangles refer to states in which the receiver has decoded correctly. A packet loss occurs if there is a 
decoding failure followed by a NACK— )-ACK error in the first two rounds, or if decoding fails in all three 
attempts. All other outcomes correspond to cases where the receiver is able to decode the packet in some 
round, and thus successful delivery of the packet. In these cases, however, the number of ARQ rounds 
depends on the first time at which the receiver can decode and when the ACK is correctly delivered. (If 
an ACK is not successfully delivered, it may take up to d rounds before the transmitter moves on to the 
next packet.) Notice that after the d-th attempt, the transmitter moves on to the next packet regardless of 
what acknowledgement is received; this is due to the delay constraint that the transmitter follows. 

Based on the figure and the independence of decoding and feedback errors across rounds, the probability 
that a packet is lost (i.e., it is not successfully delivered within d rounds) is: 

= e • efb + £'(1 - eft)efb + • • • + e'^~\l - e^)'^-^e^ + e\l - e^)'^-\ (23) 

where the first d— 1 terms represent decoding failures followed by a NACK— )• ACK error (more specifically, 
the Z-th term corresponds to Z — 1 decoding failures and I — 1 correct NACK transmissions, followed by 
another decoding failure and a NACK— s-ACK error), and the last term is the probability of d decoding 
failures and d — \ correct NACK transmissions. If we alternatively compute the success probability, we 
get the following different expression for ^rf: 

d 

= 1 - - e) • e'-' • (1 - ^^fbr\ (24) 

i=l 

where the z-th summand is the probability that successful forward transmission occurs in the z-th ARQ 
round. Based upon (l23l) and (l24l) we see that is increasing in both e and e^. Thus, a desired packet 
loss probability can be achieved by different combinations of the forward channel reliability and the 
feedback channel reliability: a less reliable forward channel requires a more reliable feedback channel, 
and vice versa. 

As in Section IIV-CI we impose a reliability constraint < q, which by (l23l) translates to a joint 
constraint on e and 6^,. The relatively complicated joint constraint can be accurately approximated by 
two much simpler constraints. Since we must satisfy e < qa even with perfect feedback (e^ = 0), for 
any Cft, > we also must satisfy e < qd (this ensures that d consecutive decoding failures do not occur 
too frequently). Furthermore, by examining ( [23] ) it is evident that the first term is dominant in the packet 
loss probability expression. Thus the constraint Cd ^ Q essentially translates to the simplified constraints 

£ • £fb < 'Z and e < qd. (25) 
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These simplified constraints are very accurate for values of e not too close to qd. On the other hand, as 
e approaches qd, Sfb must go to zero very rapidly (i.e. much faster than q/e) in order for < Q- 

The first constraint in ( [251 ) reveals a general design principle: the combination of the forward and 
feedback channel must be sufficiently reliable. This is because e • Sft, is precisely the probability that a 
packet is lost because the initial transmission is decoded incorrectly and is followed by a NACK— s-ACK 
error. 

Having established the reliability constraint, we now proceed to maximizing goodput while taking 
acknowledgement errors and ARQ overhead into account. With respect to the long-term average goodput, 
by applying the renewal-reward theorem again we obtain: 

where random variable X is the number of ARQ rounds per packet, and E[X] is derived in Appendix 
iBl Here, is the feedback overhead penalty because each packet spanning n symbols is followed by 
/ symbols to convey the acknowledgement. 

We now maximize goodput with respect to both the forward and feedback channel error probabilities: 

e ,efb = argmax -—- ■ — (27) 

subject to £,d < q 

noting that Sfb is a decreasing function of the number of feedback symbols /, according to ((22l) . This 
optimization is not analytically tractable, but can be easily solved numerically and can be understood 
through examination of the dominant relationships. The overhead factor n/{n + f) clearly depends only 
on Sfb (i.e., /). Although the second term — ^(i)/E[X] depends on both e and ea, the dependence 
upon efb is relatively minor as long as is reasonably small (i.e. less than 10%). Thus, it is reasonable 
to consider the perfect feedback setting, in which case the second term is /^^(l — e). Therefore, the 
challenge is balancing the feedback channel overhead factor with the efficiency of the forward 
channel, approximately — e), while satisfying the constraint in (l25l ). If / is chosen small, the 

feedback errors must be compensated with a very reliable, and thus inefficient, forward channel; on the 
other hand, choosing / large incurs a large feedback overhead penalty but allows for a less reliable, and 
thus more efficient, forward channel. 

In Fig. [H the jointly optimal (e*, e^) are plotted for a conservative set of forward channel parameters 
(L = 3 with SNR = 5 or 10 dB, and n = 200 data symbols per packet), stringent delay and reliability 
constraints (up to d = 3 ARQ rounds and a reliability constraint q = 10^^), and different diversity orders 
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(Lfb = 1,2 and 5) for the feedback channel. Also plotted is the curve specifying the (e, ea) pairs that 
achieve the reliability constraint = q. As discussed earlier, this curve has two distinct regions: for 
e < 0.008 it is essentially the straight line e • = 9, whereas Eft, must go to zero very quickly as e 
approaches q^/^ = 10~^. 

When Lfb = 2, the optimal point corresponds to the transition between these two regions. Moving to the 
right of the optimal corresponds to making the PHY more reliable while making the control channel less 
reliable (i.e., decreasing e and /), but this is suboptimal because the overhead savings do not compensate 
for the loss incurred by a more reliable PHY. On the other hand, moving to the left is suboptimal because 
only a very modest increase in e is allowed, and this increase comes at a large expense in terms of control 
symbols. If Lfb = 5, the optimal point is further to the left because the feedback overhead required to 
achieve a desired error rate is reduced. However, the behavior is quite different if there is no diversity 
on the feedback channel (Lfb = 1). Without diversity, the feedback error probability decreases extremely 
slowly with / (at order 1//), and thus a very large / is required to achieve a reasonable feedback error 
probability. In this extreme case, it is optimal to sacrifice significant PHY efficiency and choose e quite 
a bit smaller than q^^'^ = 10^^. Notice that increasing SNR moves the optimal to the left for all values 
of Lfb because a larger SNR improves the feedback channel reliability while not significantly changing 
the behavior of the forward channel. 

This behavior is further explained in Fig. |9j where goodput r] (optimized with respect to efb) is plotted 
versus forward error probability e for the parameters of the previous figure, with SNR = 5 dB and 
Lfb = 1 and 2 here. The figure illustrates the stark contrast with respect to feedback channel diversity: 
with diversity (even for Lfb = 2), the goodput increases monotonically up to a point quite close to q^^'^, 
while without diversity the goodput peaks at a point far below q^^^. This is due to the huge difference in 
the feedback channel reliability with and without diversity: in order to achieve Cfb = lO^'^, at SNR = 5 
dB without diversity / = 79 symbols are required, whereas / = 9 suffices for Lfb = 2. To more clearly 
understand why the optimal point with diversity is so close to q^^'^', let us contrast two different choices 
of e for Lfb = 2. At the optimal e = 8 x 10~^, we require Sfb = 6.3 x 10^^ and thus / = 34. On the other 
hand, at the suboptimal e = 10"^ we require Sfb = 10^^ and thus / = 9. Reducing the forward error 
probability by a factor of 8 reduces the feedback overhead from ^ to 2^9, but reduces the transmitted 
rate by about 50%. 

The takeaway message of this analysis is clear: as long as the feedback channel has at least some 
diversity (e.g., through frequency or antennas), stringent post-ARQ reliability constraints should be 
satisfied by increasing the reliability of the feedback channel instead of increasing the forward channel 
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reliability. This is another consequence of the fact that decreasing the forward channel error probability 
requires a huge backoff in terms of transmitted rate, which in this case is not compensated by the 
corresponding decrease in feedback overhead. 



While up to now we have considered simple ARQ, contemporary wireless systems often utilize more 
powerful hybrid-ARQ (HARQ) techniques. When incremental redundancy (IR) HARQ, which is the most 
powerful type of HARQ, is implemented, a NACK triggers the transmission of extra parity check bits 
instead of re-transmission of the original packet, and the receiver attempts to decode a packet on the 
basis of all previous transmissions related to that packet. This corresponds to accumulation of mutual 
information across HARQ rounds, and thus essentially matches the transmitted rate to the instantaneous 
channel conditions without requiring CSI at the transmitter |[TOl . |[T4|| . The focus of this section is 
understanding how the PHY transmitted rate should be chosen when HARQ is used. 

Unlike simple ARQ, HARQ requires the receiver to keep information from previous rounds in memory; 
partly for this reason, HARQ is generally implemented in a two-layered system (e.g., in 4G cellular 
networks such as LTE |[22ll |[23l ) in which the HARQ process has to restart (triggered by a higher-layer 
simple ARQ re-transmission) if the number of HARQ rounds reaches a defined maximum. The precise 
model we study is described as follows. As before, each HARQ transmission (i.e., round) experiences 
a diversity order of L. However, a maximum of M HARQ rounds are allowed per packet. If a packet 
cannot be decoded after M HARQ rounds, a post-HARQ outage is declared. This triggers a higher-layer 
simple ARQ re-transmission, which restarts the HARQ process for that packet. This two-layered ARQ 
process continues (indefinitely) until the packet is successfully received at the receiver. For the sake of 
simplicity, we proceed under the ideal assumptions discussed in Section |llll Note that the case M = 1 
reverts to the simple ARQ model discussed in the rest of the paper. 

Given this model, the first-HARQ-round outage probability, denoted ei, is exactly the same as the 
non-HARQ outage probability with the same SNR, diversity order L, and rate R , i.e.. 



In this expression R is the transmitted rate during the first HARQ round, which we refer to as the HARQ 
initial rate -Rinit hereafter. Because IR leads to accumulation of mutual information, the number of HARQ 



V. Hybrid-ARQ 




(28) 
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rounds needed to decode a packet is the smallest integer T (1 < T < M) such that 

> Rimi- (29) 



E fzEl°g2 (l+SNR|/l„f) j 
i=l \ j=l J 



Therefore, the post-HARQ outage, denoted by e, is: 

M / , L 

e(SNR, L, M, Riait 



. L 

i=i \ j=i 



R 



init 



(30) 



This is the probability that a packet fails to be decoded after M HARQ rounds, and thus is the probability 
that the HARQ process has to be restarted. 

Using the renewal-reward theorem as in ifTOll yields the following expression for the long-term average 
goodput with HARQ: 

- e) 

^ E[T] ' ^ ^ 

where the distribution of T is determined by ( |29l ). Our interest is in finding the initial rate Ri^it that 
maximizes t]. This optimization is not analytically tractable, but we can nonetheless provide some insight. 

In Fig. [TOl goodput is plotted versus vs. i?init for L = 2 and a maximum of M = 2 HARQ rounds, 
as well as for a system using only simple ARQ (i.e., M = 1) with the same L = 2, at SNR = 5 and 
10 dB. We immediately observe that goodput with HARQ is maximized at a considerably higher rate 
than for the system without HARQ. Although we do not have analytical proof, we conjecture that the 
goodput-maximizing initial rate with HARQ is always larger than the maximizing rate without HARQ 
(for equal diversity order per round/transmission). In fact, with HARQ the initial rate should be chosen 
such that the first-round outage ei is quite large, and for larger values of M the optimizer actually trends 
towards one. If si is small, then HARQ is rarely used which means that the rate-matching capability 
provided by HARQ is not exploited. However, R\nit should not be chosen so large such that there is 
significant probability of post-HARQ outage, because this leads to a simple ARQ re-transmission and 
thus forces HARQ to re-stait. The following theorem provides an upper bound on the optimal initial rate: 

Theorem 1: For any SNR,L, and M, the optimal initial rate with HARQ is upper bounded by 1/M 
times the optimal transmitted rate for a non-HARQ system with diversity order ML. 
Proof: The HARQ goodput can be rewritten as 

-Rinit X M 
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Based on (l30l) we see that the post-HARQ outage probabiUty e is precisely the same as the outage 
probability for a non-HARQ system with diversity order ML and transmitted rate R\an/M. Therefore, 
the term (i?init/M)(l — e) in ([32]) is precisely the goodput for a non-HARQ system with diversity order 
ML. Based on ( |29l ) we can see that the term M/E[7^ is decreasing in Rin\t/M, and thus the value of 
Rinit/M that maximizes ( [32l ) is smaller than the value that maximizes {R\n\t/M){l — e). ■ 
Notice that ML is the maximum diversity experienced by a packet if HARQ is used, whereas ML is 
the precise diversity order experienced by each packet in the reference system (in the theorem) without 
HARQ. Combined with our earlier observation, we see that the initial rate should be chosen large enough 
such that HARQ is sufficiently utilized, but not so large such that simple ARQ is overly used. 

VI. Conclusion 

In this paper we have conducted a detailed study of the optimum physical layer reliability when 
simple ARQ is used to re-transmit incorrectly decoded packets. Our findings show that when a cross- 
layer perspective is taken, it is optimal to use a rather unreliable physical layer (e.g., a packet error 
probability of 10% for a wide range of channel parameters). The fundamental reason for this is that 
making the physical layer very reliable requires a very conservative transmitted rate in a fading channel 
(without instantaneous channel knowledge at the transmitter). 

Our findings are quite general, in the sense that the PHY should not be operated reliably even in 
scenarios in which intuition might suggest PHY-level reliability is necessary. For example, if a smaller 
packet error mis-detection probability is desired, it is much more efficient to utilize additional error 
detection bits (e.g., CRC) as compared to performing additional error correction (i.e., making the PHY 
more reliable). A delay constraint imposes an upper bound on the number of ARQ re-transmissions and 
an upper limit on the PHY error probability, but an optimized system should operate at exactly this 
level and no lower. Finally, when acknowledgement errors are taken into account and high end-to-end 
reliability is required, such reliability should be achieved by designing a reliable feedback channel instead 
of a reliable data (PHY) channel. 

In a broader context, one important message is that traditional diversity metrics, which characterize 
how quickly the probability of error can be made very small, may no longer be appropriate for wireless 
systems due to the presence of ARQ. As seen in |[24ll in the context of multi-antenna communication, 
this change can significantly reduce the attractiveness of transmit diversity techniques that reduce error 
at the expense of rate. 
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Appendix A 
PROOF OF Proposition [I] 

We first prove the strict concavity of Tjg. For any invertible function /(•), the following holds ll25l : 



By combining this with Q{x) = '^^^ ^ S^*- 

(Q-i(£))' = -V2^e'^^, (34) 
which is strictly negative. According to this, the second derivative of r\g(e) is: 

(r?,(e))" = ^^[Q-\e)U2^{\-e)^e''^Q-\e)]. (35) 



Because k [Q ^(e))' < 0, in order to prove {r]g{e))" < we only need to show that the expression 
inside the parenthesis in (l35l) is strictly positive. If we substitute e = Q{x) (here we define x = Q~^{e)) 
, then we only need to prove {Q{x) — l)e~x < w ^. Notice when x > 0, the left hand side is negative 
(because Q{x) < 1) and the inequality holds. When x < 0, the left hand side becomes Q{—x)e 2 (— x). 
From ||23, Q(-x) < -y=-, — re~~, so if x < 0, 

{Q{x) - l)e'^x < -e-'^e'^i-x) = ^ < J-- (36) 

\/2Tr(-x) V27r V vr 



As a result, the second derivative of r]g{e) is strictly smaller than zero and thus r]g is strictly concave in 
e. Since rjg is strictly concave in e, we reach the fixed point equation in ( fT5] ) by setting the first derivative 
to zero. The concavity of rjg implies (%(e))' is decreasing in e, and thus from (fTSl ) we see that e* is 
increasing in k. 

Appendix B 

Expected ARQ Rounds with Acknowledgement Errors 
If the ARQ process terminates after i rounds (1 < i < d — 1), the reasons for that can be: 

• The first i decoding attempts are unsuccessful, the first i — 1 NACKs are received correctly, but a 
NACK— s-ACK error happens in the i-th round, the probability of which is e* • (1 — Cft,)*"^ • 

• The packet is decoded correctly in the j-th round (for 1 < j < i), but the ACK is not correctly 
received until the i-th round. This corresponds to j — 1 decoding failures with correct acknowledge- 
ments, followed by a decoding success and i — j acknowledgement errors (ACK— s-NACK), and then 



a correct acknowledgement: Yl]=i ^(1 ~ efb)-' (l — '' 
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These events are all exclusive, and thus we can sum the above probabiUties. For X = d, we notice that 
the ARQ process takes the maximum of d rounds if: 

• There are d decoding failures with d— 1 correct NACKs, the probability of which is Sfb)'^"^. 

• The packet is decoded correctly in the j-th round (for 1 < j < d — 1), but the ACK is never received 
correctly. This corresponds to j — 1 decoding failures with correct NACKs, followed by a decoding 
success and d-j acknowledgement errors (ACK^NACK): Y.'^-Z] e^-'^{l - efb)-''"^! - 

These events are again exclusive. Therefore, the expected number of rounds is: 

d-l / i 

E[X] = £^.(l-£ft)-l.£fl, + ^£i-l(l-£ft)i(l-£)4-^ 

i=l \ j = l 

+d- |^£'^-i-(l-efb)"-i + 5^e^-Hl-£fbrHl-e)4"'j • (37) 
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Fig. 1. Gooput ri (bits/symbol) vs. PHY outage probability e for L = 2, 5, SNR = 10 dB 




Ql , , , , , , , , 

-10 -5 5 10 15 20 25 30 

SNR (dB) 



Fig. 2. Optimal e vs. SNR (dB) for L = 2, 5, 10 
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Fig. 5. Success probability 1 — e vs. transmitted rate Rs (bits/symbol) for n = 50, 200, oo, L = 10 at SNR = and 10 dB 
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Fig. 8. (e*,e^) with Lfb ~ 1,2 and 5 in Rayleigh fading feedback channel for n — 200, d — 3, q = W ^, and L = 3 at 
SNR = 5 and 10 dB. The curve specifying the (e,efb) pairs that achieve the reliability constraint = Q is also plotted. 
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Fig. 9. Goodput rj (bits/symbol) vs. PHY outage probability e with Ln, = 1 and 2 in Rayleigh fading feedback channel for 
SNR = 5 dB, n = 200, L = 3, d = 3 and g = 10'^ 
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Fig. 10. Goodput (bits/symbol) vs. initial rate (bits/symbol) with HARQ for M = 2 and L = 2 and without HARQ for M = 1 
and L = 2 at SNR = 5, 10 dB. 
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